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In this expository and resources chapter we review selected aspects of the 
mathematics of dynamical systems, stability, and chaos, within a histor- 
ical framework that draws together two threads of its early development: 
celestial mechanics and control theory, and focussing on qualitative the- 
ory. From this perspective we show how concepts of stability enable us 
to classify dynamical equations and their solutions and connect the key 
issues of nonlinearity, bifurcation, control, and uncertainty that are com- 
mon to time- dependent problems in natural and engineered systems. We 
discuss stability and bifurcations in three simple model problems, and 
conclude with a survey of recent extensions of stability theory to complex 
networks. 



1. Introduction 

Deep in the heart of northern England, on the banks of a river near a village 
at the edge of the Lancashire Pennines, there is a fine brick building dating 
from the late nineteenth century. Here dwell two stout, well-preserved old 
ladies named Victoria and Alexandra. They will never invite you in for 
tea though, for the building is the Ellenroad Mill Engine House and the 
two Ladies are a giant, twin compound steam engine operating in tandem, 
originally built in 1892. On weekends willing teams of overalled maids and 
butlers oil and polish the Ladies and fire up the old Lancashire boiler that 
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delivers the steam to their cylinders to move the pistons that drive the 
giant, 80-ton flywheel. 

The speed of the engines is controlled by a centrifugal governoiB, and 
the motions of this device, occurring on time and spatial scales that can be 
appreciated by the human visual cortex, are fascinating to watch. Originally 
patented by James Watt in 1789, the centrifugal steam engine governor is 
the most celebrated prototype example of a self-regulating feedback mecha- 
nism. The device consists of two steel balls hinged on a rotating shaft which 
is spun from a belt or gears connected to the flywheel, Figure [TJ In stable 
operation, as the speed of the engine increases the inertia of the flyballs 
swings the arms outwards, contracting the aperture of a valve which con- 
trols the speed of rotation by restricting the steam supply. If the engine 
lags due to an additional, imprecisely known, load (in the mill this might 
have been another loom connected up to the engine by a belt drive) the 
flyballs are lowered and the valve opens, increasing the steam supply to 
compensate. Thus the design of the governor cleverly uses the disturbance 
itself, or deviation from set-point or desired performance, to actuate the 
restoring force. 



In certain operating regimes the motions of the governor may lose sta- 
bility, becoming oscillatory and spasmodic, amplifying the effect of the dis- 
turbance and thwarting control of the engine. Nineteenth century engineers 
called this unstable behaviour hunting and devoted much effort to improv- 
ing the design of centrifugal governors. James Clarke Maxwell was the first 
to formulate and analyse the stability of the equations of motion of the gov- 
ernor, explaining the onset of hunting behaviour in mathematical terms 
followed (independently) by VyshnegradskiM We analyse Vyshnegradskii's 




Fig. 1. The centrifu- 
gal flyball governor (after 
Pontryagin (1962) 20 ). See 
Equations \3\ and accompa- 
nying text in section [3] for 
definitions of the labels. 



a The Greek word for governor is kubernetes, from which the mathematician Norbert 
Wiener (1894-1964) coined the term cybernetics as a name for the collective field of 
automated control and information theory. 
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Dynamical systems, stability, and chaos 3 

equations for the governor's motion in section [31 as an exemplary three di- 
mensional stability problem. 

The self-correcting centrifugal governor is a simple feedback control 
system because the changes in velocity are fed back to the steam valve. 
Its widespread adoption during the 18th and 19th centuries dramatically 
transformed the steam-driven textile mills, the mining industry, and loco- 
motion. (In 1868, the year Maxwell published "On Governors'^ there were 
an estimated 75,000 Watt governors in England alone^.) Without this de- 
vice the incipient industrial revolution could not have progressed, because 
steam engines lacking self-control would have remained hopelessly ineffi- 
cient, monstrous, contraptions, requiring more than the labour that they 
replaced to control them. 

Watt's iconic governor also embodies a radical change in the philosophy 
of science. For several hundred years the mechanical clock, with its precise 
gears and necessity for human intervention to rewind it or correct error 
and its complete absence of closed-loop feedback, had been the dominant 
motif in scientific culture. In a common metaphor, the universe was created 
and ordered by God the Clockmaker. Isaac Newton had no doubt that God 
had initiated the celestial mechanics of the motions of the planets and 
inter vene d when necessary to keep His creation perfectly adjusted and on 
trackP^l The clockwork view was also deeply satisfying to Laplace, one of 
the most influential mathematicians of the eighteenth and early nineteenth 
centuries. Stability theory was developed some two centuries and more after 
Newton published his Principia (1687), so he could not have k now n that 
the planetary orbits may be what Poincare called Poisson stable^^l (small 
perturbations are self-correcting) — or they may be chaoti<jB 

As concepts of feedback and stability were developed rigorously and ap- 
plied in the late nineteenth and early twentieth centuries, Divine open-loop 
control began to wane and there came a growing awareness of systems as 
dynamical entities that can regulate their own destiny and internally con- 
vert uncertain inputs into stable outputs. The technological advances in 
transport, power, and communications made possible by feedback control 
and applied stability theory are agents of change, the vectors of liberty, lib- 
eralism, and literacy in societies, themselves enabling the blossoming and 
seeding of more sophisticated ideas of feedback and stability in complex 



b A fact which might cause you some queasiness to learn. Fear not — it is believed that 
chaotic motions were important in the early evolution of the solar systerrJS and a slow 
chaotic drift may be noticeable a few billion years What luck for us! 
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environmental, socio-economic, and biological systems. Now, due to sta- 
bility theory and feedback control, we may contemplate "the fundamental 
interconnectedness of all things"m^, but back then, in the clockwork days, 
people could not. It is surely no coincidence that totalitarian governments 
favour clockwork metaphors. 

Today, we are so comfortable with the concept of feedback control induc- 
ing stable dynamics that we barely notice how it permeates most aspects 
of our lives. 



Control theory, then, is a major strand in the development of modern non- 
linear dynamics, but it is not the first. The centrifugal governor also trans- 
formed the practice of astronomy, in that it enabled fine control of telescope 
drives and vastly improved quantitative observations, and it is this earlier 
force (already alluded to above in mention of Newton's and Laplace's work) 
in the development of dynamical systems and stability theory — celestial 
mechanics — on which we now focus attention. The next stage of our non- 
linear dynamics odyssey takes us from the post-industrial north of England 
to the miraculously intact (given the destructions of WWII) medieval city of 
Regensburg in Germany, to an older, humbler but no less important build- 
ing than that which houses the Ladies, the Kepler museum. In addition to 
celebrating the life and work of Johannes Kepler (1571-1630) the museum 
houses priceless manuscripts, letters, publications, and astronomical instru- 
ments and interpretive exhibits that tell a lively and inspiring story, that 
of the development of celestial mechanics from Galileo to its culmination, 
in analytic terms, in the work of Poincare. 

An exhibit from the 18th century, an exquisitely engineered brass orrery, 
or clockwork model of the solar system, in its detail and precision expresses 
the satisfaction and confidence of the clockwork aficionados of the Age of 
Enlightenment. But a nearby exhibit expresses, rather presciently, the need 
for a new metaphor for scientific endeavour and achievement. It is an early 
19th century relief in which Kepler unveils the face of Urania, the Muse of 
astronomy, whereupon she insouciantly hands him a telescope and a scroll 
inscribed with his own laws, as if to say: "Hmm. . . not a bad job; now take 
these back and do some more work then tell me why your elliptical orbits 
are non-generic". (See Figure [21) And in fact the one-dimensional Kepler 
ellipse can be transformed into a harmonic oscillator with HamiltoniarA^ 



H(Q,P) = -P 2 ~EQ 2 . 



(1) 
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Fig. 2. Johannes Kepler is given 
cheek by his Muse after two long 
centuries of ellipses and clockworks. 



Despite Laplace's confidence the problem of the stability of the solar 
system refused to go away, but instead took on a central role in the preoc- 
cupations of mathematicians, physicists, astronomers, and navigators post- 
Newton. It was by no means clear, even to Newton, that Newton's law was 
sufficient to describe the motions of three or more celestial bodies under mu- 
tual gravitational attraction. The problem also refused to be solved, in the 
sense of what was accepted as a "solution" during the latter 18th century 
and first half of the 19th century, i.e., analytically in terms of elementary 
or previously- known special functions. 

Progress was made in the mid- 1800s in improving series approximations 
but, not surprisingly, the hydra of nonconvergence soon raised one after the 
other of its ugly (of course!) heads. By 1885, when it was chosen by Weier- 
strass as one of four problems in the mathematics competition sponsored by 
King Oscar II of Sweden, the n-body problem had achieved notoriety for its 
recalcitrance — but in doing so it had also driven many of the seminal ad- 
vances in mathematics and produced many of the greatest mathematicians 
of the 19th century. 

The first problem in King Oscar's competition was to show that the 
solar system as modeled by Newton's equations is stable. In his (corrected) 
entry-^Poincare invented or substantially extended integral invariants, char- 
acteristic exponents, and Poincare maps (obviously) , invented and proved 
the recurrence theorem, proved the nonexistence of uniform first inte- 
grals of the three body problem, other than the known ones, discovered 
asymptotic solutions and homoclinic points, and wrote the first ever 
description of chaotic motion — in short, founded and developed the entire 
subject of geometric and qualitative analysis. Then he concluded by saying 
he regarded his work as only a preliminary survey from which he hoped 
future progress would result. 

Poincare's "preliminary survey" is still inspiring new mathematics and 
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applications, but during the 20th century the collective dynamic of dy- 
namical systems development was highly nonlinear. Homoclinic points and 
homoclinic chaos were partially treated by the American mathematician 
George Birkhoff (1884-1944) — he obtained rigorous results on the exis- 
tence of periodic orbits near a homoclinic orbit — and by Cartwright and 
Littlewood in their study of Van der Pol's (non-Hamiltonian) equation^], 

y - k(l - y 2 )y + y = b\k cos(Xt a ). 

Cartwright and Littlewood stated numerous "bizarre" properties of solu- 
tions of this differential equation, implying the existence of an invariant 
Cantor set, but their very concise paper was not ea sy to penetrate, and 
their results remained largely unknown until LevinsorM^ pointed them out 
to Stephen Smale. 

During the 1960s and 1970s Smale's representation of homoclinic chaos 
in terms of symbolic dynamics and the horseshoe ma stimulated re- 
newed interest in dynamical systems (although we have skipped a lot of 
mathematical history here, most notably KAM theory). Happily, this co- 
incided with the advent of desktop digital computers subject to Moore's 
law. Since the 1980s improvements in processor speed have both driven 
and been driven by the use of computational simulations of dynamical sys- 
tems as virtual experiments, and inspired advances in fields such as network 
stability, numerical instabilities, and turbulence. Essentially these advances 
are sophisticated and technologically facilitated applications of Poincare's 
and Lyapunov's stability theory, and in the next section we present the 
basics and some working definitions. 

It is somewhat ironic that improvements in processor speed have also 
led to renewed interest in low dimensional dynamical systems, which usu- 
ally only require small-time computing and are at least partially amenable 
to rigorous stability analysis. For large dynamical systems usually mean 
turbulent ones, and computation is, in essence, the notorious "problem of 
turbulence" . In a turbulent flow energy is distributed among wavenumbers 
that range over perhaps seven orders of magnitude (for, say, a tokamak) to 
twelve orders of magnitude (for a really huge system, say a supernova). To 
simulate a turbulent flow in the computer it is necessary to re solv e all rele- 
vant scales of motion in three dimensions. It is a fair estimati^ that such 
calculations would take 400 years at today's processor speeds, therefore a 
faster way to do them would be to rely on Moore's law and wait only 20 
years until computers are speedy enough. 

Many of us in the turbulence business have realized that while we are 
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waiting we can, more expediently, apply reduced dynamical systems meth- 
ods to the problem, such as Karhunen-Loeve (KL) decomposition^], to dis- 
till out a much- reduced, but nevertheless sophisticated, approximation to 
the dynamics and spatial structure of a turbulent flow^A To introduce KL 
decomposition, we imagine a fractional distillation tower for which the feed- 
stock is not crude oil but a high Reynolds number flow. Then instead of a 
natural distribution over hydrocarbon molecular weights wc have an energy 
distribution over scales of motion. We know, in principle, how hydrocarbons 
are separated in the still according to their boiling points (even if we do not 
work at an oil refinery), but what properties may we exploit to separate 
and re-form the energy components of a turbulent flow? Our turbulence 
refinery does not define the skyline of a seamy port city in complicated 
chiaroscuro, but exists more conveniently in constrained fluid flow exper- 
iments or as direct numerical simulations of the Navier-Stokes equations 
in silico. The KL transform operates on data to yield eigenfunctions that 
capture in decreasing order most of the kinetic energy of the system, so it 
is especially useful for highly self-structured flows. 



2. To understand stability is to understand dynamics 

Very few dynamical systems have known, exact solutions. For the vast ma- 
jority it cannot even be proved that general solutions exist. Stability theory 
is quite indifferent to such issues; instead it tells us how families of solutions 
would behave, assuming they do exist. Loosely we understand stability to 
mean that a solution does not run away, or to refer to the resilience of a 
solution to changes in initial conditions or to changes to the equation that 
generates it. Stability is a qualitative property of dynamical equations and 
their solutions. 

For practical applications stability analysis allows us to say whether 
a given system configuration will exhibit runaway dynamics (catastrophic 



c Also known by the aliases proper orthogonal or singular value decomposition, principal 
component analysis, and empirical eigenfunction analysis. 
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failure) or return to a stable quasi-equilibrium, limit cycle, or other attrac- 
tor, in response to perturbation. We have indicated in section [T] above how 
the issue of stability of the planetary orbits drove the development of celes- 
tial mechanics, but stability is equally important in control theory — from 
a design and operational point of view it could be said that control is ap- 
plied stability. It is a grave issue because, as we show in section[3j feedback 
can result in systems that fail due to instabilities, as well as create ones 
which maintain homeostasis. Thermal explosions, ecological "arms races", 
and economic depressions are all more-or-less disastrous consequences of 
unstable feedback dynamics. A big stability question that occupies many 
scientists today concerns the long-term stability of the world's climate in 
response to the enhanced greenhouse effect; questions related to stability 
of other complex systems will be explored in section [S] 

In this section we give precise mathematical expression to these con- 
cepts of stability, for later reference. For more detail and discussion the 
reader is referred to the article in Scholarpedia curated by Holmes and 
Shea-BrowiM 

Consider the general dynamical system in vector form 



where f l (t,x) and the derivatives d/ l (t,x)/9x 3 ' are defined and continu- 
ous on a domain T of the space of t, x. Let 7t(x) = x(t) with the initial 
value x(0) = x. Then, the (forward) orbit is the set of all values that this 
trajectory obtains: 7(x) = {7 t (x)|i > 0}. 

Definition 1: Two orbits 7(x) and 7(x) are e-close if there is a repa- 
rameterization of time (a smooth, monotonic function) t(t) such that 
l7t(x) -7£(t)(x)l < e for alii >0. 

Definition 2: Orbital or generalized Lyapunov stability. 7(x) is or- 
bitally stable if, for any e > 0, there is a neighbourhood V of x so that, for 
all x in V, 7(x) and 7(x) are e-close. 

Definition 3: Generalised asymptotic stability. If additionally V may 
be chosen so that, for all x G V, there exists a constant r(x) so that 
|7t(x) — 7t_ T (i)(x)| — > as t — > oo then 7t(x) is asymptotically stable. 

These general definitions of Lyapunov stability and asymptotic stability 
are indifferent to the choice of initial values ioi x (0). Lyapunov stability is 
intimated in Figure El which sketches a segment of an orbit 7(x) and a 
segment of a neighbouring orbit 7(x), in periodic and non-periodic cases. 



x = f(i,x), 



(2) 
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Fig. 3. The orbit 7(x) is orbitally stable. The black lines indicate the boundary of an 
e-ncighborhood of 7(x). 

In the particular case where the system ([2]) is autonomous and the 
solution is an equilibrium x e we have the following specifications: 

Definition 4: Lyapunov stability of equilibria. x e is a stable equilib- 
rium if for every neighborhood U of x e there is a neighborhood V C U of 
x e such that every solution x(i) starting in T^(x(0) G V) remains in U for 
all t > 0. Notice that x(i) need not approach x e . Lyapunov stability means 
that when all orbits starting from a small neighbourhood of a solution re- 
main forever in a small neighborhood of that solution the motion is stable, 
otherwise it is unstable. If x e is not stable, it is unstable. 

Definition 5: Asymptotic stability of equilibria. An equilibrium x e 
is asymptotically stable if it is Lyapunov stable and additionally V can be 
chosen so that x(t) — x e — > as t — > oo for all x(0) G V. An asymptotically 
stable equilibrium (stationary state) and its local environment is sketched 
in Figured! 

It is all very well to settle the stability properties of a solution, but 
what then? If, as is usually the case, we are studying Eq. [2] as a model 
for coupled physical motions or a system of rate processes, and therefore 
necessarily imperfect, we also need information about how those properties 
fare under perturbations to the model, or structural stability. The question 
usually goes something like this: When are sufficiently small perturbations 
of a dynamical system equivalent to the original unperturbed dynamical 
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Fig. 4. An asymptotically stable equilibrium is also called a sink. 



system? And if a system is not structurally stable, how may one unfold it 
until it is? And what (new mathematics, physics) do the unfoldings reveal? 
The concept of structural stability has yielded a rich taxonomy of bifur- 
cations and of different classes of vector fields. Structural stability is thus 
fundamentally a classification science, a binomial key of the type that has 
been used in biology since the method was devised by the Swedish botanist 
Linnaeus (1707-1778). It is more distracting than useful to define structural 
stability rigorously at this stage (although authorita tive definitions can be 
found in the literature, e.g., Hirsch and Smale (1974)P^j); instead, we shall 
illustrate some of the concepts in section|4]in relation to a perturbed simple 
pendulum as a simplified surrogate for the restricted three body problem. 

3. Governor equations of motion: a simple case study 

Now that we have some background and theory resources to draw on, let us 
carry out a stability analysis of the centrifugal governor. This analysis is all 
the more important for being elementary because it introduces many of the 
key concepts of dynamical systems theory in a setting that is understand- 
able to non-mathematician physical scientists and engineers and also sets 
the scene for the more complicated motions we describe in sections 2] and 
[5l Vyshnegradskii's equations of motion for the flyball governor sketched in 
Figure [T] were given as a 3-dimensional, autonomous, first-order dynamical 
system by Pontryagin 

(1962 jlS 




dtp 



dt 

dt 
du> 

~dt 



2 2- • u i 

n u) sin ip cos ip — g sin ip ip 




rn 



(3) 
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where <p is the angle between the spindle S and the fiyball arms L, u) is the 
rotational velocity of the flywheel, the transmission ratio n — 0/lu, 6 is the 
angular velocity of 5, g is the gravitational acceleration, m is the fiyball 
mass, J is the moment of inertia of the flywheel, F represents the net load 
on the engine, k > is a constant, and b is a frictional coefficient. The 
length of the arms L is taken as unity. For a given load F the engine speed 
and fly-ball angle are required to remain constant, and the unique steady 
state or equilibrium coordinates are easily found as ipo = 0, costpo = F/k, 
n 2 LUQ — gj cost^o- So far, so dull. 

Dull, too, are the designers of engines, according to Maxwell. In his 
treatment of the governor problem, which was more general than that of 
Vyshnegradskii, he wrote: "The actual motions corresponding to these im- 
possible roots are not generally taken notice of by the inventors of such 
machines, who naturally confine their attention to the way in which it is 
designed to act; and this is generally expressed by the real root of the 
equation." The impossible roots he referred to are the complex roots of 
the characteristic equation obtained from the linearized equations of mo- 
tion. Maxwell and Vyshnegradskii both used this method to investigate the 
mathematical stability of the engine-governor dynamical system and relate 
the results closely to observed misbehaviours of the physical system. Their 
linear stability analyses provide criteria for which the system returns to its 
equilibrium engine speed coq and fiyball angle tpo when subjected to a small 
perturbation. Let us represent the perturbed system by setting 

<-P = + Sip, tp = -00 + Sip, uj — uj + Suj, 

with \S(p\, \8ip\, \8u>\ <C 1, and recasting equations ((3J as 

Jt SiP = 

Lty = -3™'*% - Aty + fa (4) 

dt cos tpo m loq 

d k 

—8uj = — -sin^o^, 

dt J 

where we have neglected terms that are quadratic in the small perturbations 
Sip, Sift, and 8u>. Equations Q are a linear system with constant coefficients 
that may be written succintly in matrix form 



x = Ax, 



(5) 
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where 








3 sin yp 

cos ipo 1 

j sin cpo 




Equation ([5]) has nontrivial, linearly independent solutions of the form 



ue 



A/ 



(6) 



where the constant components of u and the constant A may be complex. 
Differentiating © with respect to t and substituting in ([5]) gives the eigen- 
value problem 

(A - AI) u = (7) 

where I is the identity matrix. The requirement that u ^ 0, needed to obtain 
nontrivial solutions, satisfies (JTJ) if and only if the factor det (A — AI) = 0, 
or 

-A 1 



g sin ipo b_ _ \ 2g sin (£q 

COS (fo 771 U)Q 

-ksimpo —A 



0. (8) 



The determinant may be evaluated and equation (JSJ) expressed in terms of 
the characteristic polynomial: 

o b , 9 <7sin 2 c9o^ 2g/csin 2 (/3n „ ,„n 

A 3 H A 2 + ^A + — — = 0. (9) 

m cos tpo Jloq 

The roots Ai , A2 , A3 of ([9]) are the eigenvalues of A and the solutions 
Ui, U2, U3 of ([7]) are the corresponding eigenvectors. By inspection of equa- 
tion ((6J stability can ensue only if the real eigenvalues, or real parts of 
complex eigenvalues are negative. From analysis of the characteristic equa- 
tion ((9|) this condition can be written as 

-^>i. do) 

Now let us consider the dynamical behaviour of the engine-governor 
system in the light of lfT0|) and with the aid of Figure O In (a) and (b) 
the equilibria and linear stability of equations [3] have been computed nu- 
merically and plotted as a function of the friction coefficient b. This is a 
bifurcation diagram, where the bifurcation or control parameter b is as- 
sumed to be quasistatically variable, rendered in the variables if (a) and lo 
(b). We see immediately that stable, steady state operation of the engine- 
governor system requires frictional dissipation above a critical value. As 
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b is decreased through the Hopf bifurcation point HB the real parts of 
a pair of conjugate eigenvalues become positive, the equilibrium becomes 
unstable, and the motion becomes oscillatory. The envelope of the periodic 
solutions grows as b is decreased further, which is also deduced in the in- 
equality (| lOjl : a decrease in the coefficient of friction can destabilize the 
system. 




b 0.5 o b 2 

Fig. 5. Bifurcation diagrams rendered for the variables tp (a) and lu (b), stable equilibria 
are marked by a solid line, unstable equilibria are marked by a dashed line, HB stands 
for Hopf bifurcation, NS stands for Neimark-Sacker bifurcation, black dots mark the 
amplitude envelope of the oscillations, (c) The period r of the oscillations decreases with 
b. (d) Continuations at the Hopf bifurcation in the parameters J and F. 



As the bifurcation parameter b is decreased through the marked value 
with the label NS the stable periodic solution, for which the Floquet mul- 
tipliers have modulus < 1, undergoes a Niemark-Sacker bifurcation. A 
conjugate pair of multipliers leaves the unit circle, and a two-dimen sional 
asymptotically stable invariant torus bifurcates from the limit cycle™ 
0. For b < bus the periodic solutions are unstable but the torus is stable. 
The behaviour of the system has become essentially 3-dimensional. 



d The discovery of torus bifurcations first by Niemark in the USSR and five years later 
independently by Sacker in the USA seems to be a classic case of unnecessarily duplicated 
development of mathematics during the cold war. 
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In the governor problem we have studied the stability of solutions. In the 
next section we consider structural stability, in relation to the the restricted 
three body problem from celestial mechanics. 

4. The restricted three body problem, homoclinic chaos, 
and structural stability 

This section assumes a working knowle dge of Hamiltonian mechanics from 
a text book such as Goldstein (1980)^ or from undergraduate lecture 
notes such as Dewar (2001 j2S. Rather than presume to capture the en- 
tire content and context of the restricted three body problem within the 
space of one chapter section we again summarize a small vignette from the 
panorama, a surrogate for the restricted three body problem. Homoclinic 
chaos and the associated topics of Poincare maps, symbolic dynamics, and 
the Smale horseshoe construction, are fleshed out in Guckenheimer and 
Holmes (1983^ and Holmes (1990^. 

First let us return to Kepler's ellipse, or the two-body problem of New- 
ton, which at the end of section [T] we gave in terms of the Hamiltonian for 
the transformed harmonic oscillator, Eq. [TJ The well-known simple pendu- 
lum is also a harmonic oscillator, with Hamiltonian 

H =p 2 /2+(l-cosq) (11) 

and equations of motion 

q=P, p = -sinq. (12) 

The phase portrait of the flow, Figure[6l shows the three families of periodic 
solutions bounded by the separatrices H = 2, which are emphasized in 
Figure [6l The fixed point (or equilibrium) at (q,p) = (0,0) represents the 
pendulum at rest and that at (q,p) = (±7r, 0) represents the upside-down 
position of the pendulum, keeping in mind that the flat phase portrait 
should be wrapped around a cylinder of circumference 2tt. Elementary linear 
analysis tells us that the the fixed point at (q,p) — (0,0) is a centre, with 
the solution matrix of the linearization having a pair of pure imaginary 
eigenvalues, and that at {q,p) — (±7r, 0) is a hyperbolic (or non-degenerate) 
saddle point, with the solution matrix of the linearization having having one 
positive and one negative eigenvalue. Each point of the H = 2 separatrices is 
homoclinic, or asymptotic to to the fixed point (q,p) — (±7r, 0) as t — > ±oo. 
In fact the separatrices are simultaneously the stable and unstable manifolds 
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Fig. 6. The phase space of the simple pendulum 



for the saddle point. Thus the phase portrait of the pendulum contains 
qualitative information about the global dynamics of the system. 

Now consider the restricted three body problem that featured in 
Poincare's memoir, in which two massive bodies move in circular orbits 
on a plane with a third body of negligible mass moving under the resulting 
gravitational potential. In a rotating frame the system is described by the 
position coordinates (q%, q 2 ) of the third body and the conjugate momenta 
(pi 7 p 2 ). Poincare studied the following two degree of freedom Hamiltonian 
as a proxy for this system: 



H(q 1 ,q 2 ,pi,p 2 ) = -P2 -p\ + 2^isin 2 ((7i/2) + ^esingi cos<7 2 , 
with corresponding equations of motion 
qi = -2px, q 2 = -1; 

Pi = — jj, sin qi — [is cos <?i cos q 2 , p 2 = lie sin q\ sin q 2 . 
By inversion of Eq. [T3] we have 

P2 = Ph(Qu Pi; 02) = h-pi + 2^sin 2 (gi/2) + /j,e sin qi cosg 2 , 
from which we can obtain the reduced equations of motion 
q'i = -dP h /dpi = 2pi, p[ = dPh/dqi = fx sin q x + fie cos q\ cos q 2 , 



(13) 



(14) 



(15) 



(16) 



where (•)' denotes d/dq 2 ). 

We see that Eqs [16] have the form of a periodically forced one degree of 
freedom system in which the angle variable q 2 plays the role of time. For 
e = Eqs [16] are isomorphic to those for the simple pendulum, Eqs [321 and 
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the phase portrait is that of Figure [S] (to make the origin (qi,pi) = (0,0) 
a center we set fi < 0). When a time-periodic perturbation is applied to 
the pendulum the stable and unstable manifolds that form the separatrix 
level set typically break up, but some homoclinic points may persist and 
with them small neighbourhoods of initial conditions, which are repeatedly 
mapped around in the region formerly occupied by the separatrixes. Such 
regions can now fall on both sides of the saddle point so that of two so- 
lutions starting near each other, one may find itself on the rotation side 
and the other on the oscillation side. At each juncture near the saddle 
point such solutions must decide which route to take. The global structure 
of the stable and unstable manifolds rapidly becomes very complicated. 
Poincare prudently decided that, in this thousand words are worth 

more than a picture: "When we try to represent the figure formed by [the 
stable and unstable manifolds] and their infinitely many intersections, each 
corresponding to a doubly asymptotic solution, these intersections form a 
type of trellis, tissue or grid with infinitely fine mesh. Neither of the two 
curves must ever cross itself again, but it must bend back upon itself in a 
very complex manner in order to cut acro ss a ll of the meshes in the grid an 
infinite number of times." (Poincare (1899]P^, quoted in Diacu and Holmes 
(1996)221). We have computed some orbits and rendered the data in Figure 
[3 which may or may not help to clarify the issue. 

Thus did Poincare describe homoclinic chaos, after years of careful and 
productive analysis of the phenomenon. In particular, Poincare obtained 
the following results: 

• Transverse homoclinic points exist for e ^ 0. 

A transverse homoclinic orbit occurs when the stable and unstable 
manifolds intersect transversally, i.e., the unstable manifold inter- 
sects and crosses the stable manifold. In two dimensions, continuous 
dynamical systems do not have transverse homoclinic orbits, but 
a two-dimensional Poincare map defined near a periodic orbit of a 
continuous dynamical system may have them. 

• Transverse homoclinic points obstruct the existence of second in- 
tegrals of the motion. 

• Transverse homoclinic points imply that chaotic motions exist 
nearby. 

The model problem, Eq. I13[ is essentially a simple pendulum coupled 
weakly to a linear oscillator. For the restricted three body problem itself, 
Poincare showed that after applying perturbation methods and truncating 
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Fig. 7. Segments of orbits belonging to the stable (blue) and unstable (yellow) manifolds 
of the saddle type periodic orbit of the periodically perturbed pendulum, Eqs 1161 with 
fi = —1 and e = 0.1. 

certain higher order terms in the expansion the Hamiltonian becomes com- 
pletely intcgrablc. He also showed that the reduced system, and therefore 
its Poincare map, possesses hyperbolic saddle points whose stable and un- 
stable manifolds, being level sets of the second integral, coincide, as they do 
for the pendulum illustrated in Figure El He then asked the key question in 
the qualitative approach to dynamical systems: Should I expect this picture 
to persist if I restore the higher order terms? In other words, is the reduced 
system structurally stable? It is now known that integrable Hamiltonian 
systems of two or more degrees of freedom are not structurally stable. It is 
for this reason, even if no other, that they are exciting and productive to 
study. 

In this section we have described how the structural stability of a 
Poincare map of a continuous dynamical system can be evaluated, even 
though in general such a map cannot be computed explicitly. In the next 
section we look at stability and chaos in an explicit discrete dynamical 
system. 

5. Discrete dynamics, blowflies, feedback, and stability 

In a series of population dynamics experiments, May and Oster and co- 
workers^ chose to rear blowflies in boxes (for reasons we cannot entirely 
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fathom — surely there are more alluring model species), and count their 
numbers at every generation. The blowflies in their boxes are a simple 
ecological system consisting of a single species limited by crowding and 
food supply, but with no predation. The system was analysed as a model 
of discrete chaos, and, in a different paradigm, as a control system by Mees 
(198lj^l. 

Assuming discrete generations, the data for the population dynamics of 
the blowflies can be fitted by a first-order difference equation 

N t+1 = f(N t ), (17) 

where N is the number of blowflies in the time period t. The function / 
is chosen so that f(N t ) increases when the population is small, because 
there is plenty of food and living space in the box, but decreases when the 
population is large, because of competition for food and living space. 

The simplest single-humped function for / that one can think of is a 
parabola: 

f(N)=rN(l-N), (18) 

for which Equation [17] is known as the logistic map. The parameter r is 
then the reproduction rate constant. Equation [17] then says that due to 
reproduction the population will increase at a rate proportional to the cur- 
rent population, and due to starvation the population will decrease at a 
rate proportional to the square of the current population. For example, if 
there is a large number of flies in a box in one time period, they will eat 
most of the food, and the next generation of flies will be few in number. 

The weird properties of this simple model never fail to delight people. 
Their implications for ecologies were explored in May (1974)^1* a good 
modern mathematical treatment, accompanied by downloadable software 
to play with, is given in Chapter 1 of Ball (2003)^. 

The evolution of the population N starting initially at Nq may be found 
graphically as indicated in the cobweb diagram of Figure 0(a), where the 
f(N) of Eq.[T8]is plotted against TV for a given value of r (dashed curve). A 
vertical line takes the eye from N t , the population in time- window t, to the 
corresponding f(N t ) and an adjoining horizontal line takes you from f(N t ) 
to iVt+xj the population in the time- window The solution converges to 
a point of zero population growth where the graphs of f(N) = rN(l — N) 
and f(N) = N intersect. This period- 1 fixed point (or equilibrium) is a 
stable attractor: all nearby orbits converge to it as t — > oo. 
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Fig. 8. (left) The logistic function f(N), Eg. 1181 is plotted against the population N 
for r = 2.9, (right) the second composition f{f{N)) is plotted against N for r = 3.4. 

Increasing the height of the hump, r, means increasing the reproduction 
rate in the blowfly model. For example, at r = 3.4 the equilibrium has 
become unstable and two new stable equilibria have appeared. These new 
equilibria are not fixed points of /. They are fixed points of the second 
composition map, 

f 2 (N) EE /(/(AO), 

as shown in Figure[8]Jb). Here, the initial condition JVo is the same as in (a), 
and the iterates at first take the population toward the old fixed point. But 
then they are repelled from it, because it is unstable, and converge instead 
to the two intersections of f2(N) = f(f(N)) and f2(N) = N, between 
which they oscillate in a period 2 orbit. This situation corresponds to the 
population N switching between two states: a highly populated generation 
results in the next generation being poorly populated, but then resources 
are plentiful enough to induce a populous generation again, and so on. 

One cannot help but be curious as to what happens when the parame- 
ter r is increased again, and again . . . We could compute many more of these 
cobweb diagrams, each at a different value of r, but both the diagrams and 
this chapter would become very crowded. Our curiosity can be assuaged (or 
whetted!) more succinctly by inspecting the bifurcation diagram of stable 
solutions in Figured] One can easily make out the branch points at r ~ 3, 
3.449, and 3.544 corresponding to bifurcations to period 2, 4 and 8 orbits. 
Beyond that, the period-doubling repeats until the periodic behaviour of 
the population becomes chaotic. The population never settles to discernibly 
regular n-periodic oscillations, although the window at r ~ 3.8 suggests the 
resumption of some sort of regularity. 
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Fig. 9. Bifurcation diagram over r for the logistic map, where a point is plotted for 
each solution at every increment in r. 

Blowfly dynamics as a feedback system 

So far we have viewed the blowfly system as a difference equation, to model 
the generational delay, and as a bifurcation problem, to study the stability 
of the dynamics. Picking up the theme of section [3l it is also instructive to 
view the blowfly system as a simple feedback system. 

The output of the system (number of adult blowflies) is sensed by a 
controller which implements a mechanism, approximated here by the model 
function f(N) = rN(l — N) to control the level of input, or number of 
larvae. The actuating mechanism which transforms the larvae into adult 
flies is simply the delay time of one generation. Figure \W\ represents the 
feedback system as a block diagram. 

This diagram may seem rather facile, and nowhere near as interesting 
as the cobweb or bifurcation diagrams, but it does highlight a different 
side to the problem. For instance we see that the block components are 
independent. We could change the function f(N) without changing the 
simple delay model. Inspecting this diagram also makes it easy to build in 
perturbations such as predation or injecting more flies from outside. 

The conceptual difference between modelling the blowfly population as a 
difference equation and as a feedback system is how information is treated. 
In the block diagram representation the information flow is explicit and 
the feedback is obvious, and we can immediately think up ways of adding 
additional regulations to it. In this sense feedback is an information science. 
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Fig. 10. Schematizing the blowfly system as a block diagram brings out the feedback 
nature of the dynamics. 

This information about connectivity is subsumed in the discrete dynamical 
model, which allows us to analyse the stability of the population but glosses 
over the fact that the instabilities are caused by feedback. 



6. Stability of complex networks 

The third (and final, for this chapter) destination in our world tour of non- 
linear dynamics is the 41st floor of an office tower in the district of Wan 
Chai, Hong Kong. It is here that the transport operations and infrastructure 
of Hong Kong, Kowloon, and the New Territories (which together consti- 
tute a Special Administrative Region of the People's Republic of China, 
or HKSAR) are controlled and coordinated day-to-day, and planning and 
policy development for future transport needs are carried out. 

The job of the HKSAR Department of Transport is formidable. Consider 
the problem: The public transport network carries over 11 million passen- 
ger trips each day and this number will increase. It consists of railways, 
franchised buses, public light buses, private buses, ferries, trams, and taxis. 
Each of these components is a complex sub-network in its own right. The 
area is geographically diverse, with islands, harbour, waterways, steep hills, 
airport, and old built-up districts with limited road space to be traversed 
or accessed. Environmental imperatives require the use of or conversion to 
low or zero emissions locomotive units. Efficient integration with transport 
in the densely populated economic-tiger zones of the Pearl River Delta is 
becoming necessary. The network as a whole must be safe, affordable, reli- 
able, and robust. It must minimize redundancy and duplication of services, 
yet be flexible enough to match new demand without undue time-lags and 
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provide services to new and changing population and employment centres. 
This means it must be capable of response and adaptatation on two time 
scales, daily and long-term (approximately yearly). 

What a tall order! Can one tackle this complex network problem us- 
ing the tools of dynamical systems theory? In dynamical systems language 
we ask: Is the HKSAR public transport network stable? Intuitively (or 
through direct experience) we expect such a complex network to exhibit 
sensitive dependence on initial conditions. One blinking red LED on 
a signal-room console leads to a log-jam of peak hour trains. Even with 
no perturbations on the network itself we know (with depressing certitude) 
that leaving for work five minutes later than usual is likely to result in arriv- 
ing at work an hour late. These sorts of cascade effects in networks seem to 
occur when a small disturbance in one element of a network is transmitted 
through it leading to instability as it spreads, but what lies behind these 
phenomena? 

Studying networks such as the HKSAR public transport network is 
about building models of how they function, and then analysing those mod- 
els to understand how changes in the structure of the network will result in 
changes in behaviour. Naively, one expects that increasing the fraction of 
interacting elements or increasing the strength of interaction will enhance 
the stability of a complex network, but as we will show in the next example, 
that is not necessarily so. 

In a paper in Nature in 1972 Robert MajJ231 used random matrix theory 
to show that in a large, linear, randomly coupled network the system di- 
mension and the coupling strength must together satisfy a simple inequality. 
Let us revisit the matrix equation (|5j): 



May considered this as the linearization of a (large) set of nonlinear first- 
order differential equations that describe an ecology, or populations of n 
interacting species, but it could equally well describe rates of passenger 
turnover at each of n nodes in a public transport network. The elements 
of the n x 1 column vector x are the disturbed populations Xj and the 
elements cijk of the nx n interaction matrix A describe the effect of species 
k on species j near equilibrium. Each ajk is assigned from a distribution of 
random numbers that has a mean of zero, so that any element is equally 
likely to be positive or negative, and a mean square value a, which expresses 
the average interaction strength. Then 



x = Ax. 



A = 



B-I, 
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where B is a random matrix and I is the unit matrix. 

The probability that any pair of species will interact is expressed by 
the connectance C, measured as the fraction of non-zero elements in A. 
The elements in the random matrix B are drawn from the random number 
distribution with probability C or are zero with probability 1 — C. For any 
given system of size n, average interaction strength a, and connectance C 
we ask what is the probability P(n, a, C) that any particular matrix drawn 
from the ensemble gives a stable system? May found that for large n the 
system ([5]) is almost certainly stable (P(n, a,C — + 1)) if 

a < {nC)- 1 ' 2 , 

and almost certainly unstable (P(n, a, C — > 0)) if 

a > {nC)- 1/2 . 

This result suggests that an ecology that is too richly connected (large C) 
or too strongly connected (large a) is likely to be unstable and that the 
effect is more dramatic the larger the number of species n. 

May's result is based firmly on stability theory as it was developed by 
Poincare and Lyapunov over a hundred years ago, as are more recent results 
o n st ability and control of dynamical network systems. For example, Yao et 
a|24l i n proposing a control method for chaotic systems with disturbances 
and unknown parameters (imprecisely modelled or unmodelled dynamics) 
rely on Lyapunov stability theory, as do almost all of the applications men- 
tioned by Boccaletti and Pecora (2006^23 j n the preface to a special issue 
of the journal Chaos devoted to stability of complex networks. 

7. Conclusions and inconclusions 

Although dynamical systems and stability theory was born and bred in ce- 
lestial mechanics and control engineering, we now see that the concepts and 
methods have much wider application in the biological and environmental 
sciences and in socio-economic modelling and forecasting. A goal that is 
shared by many researchers in both hard and soft science is the improved 
management, and ultimately a priori design, of complex dynamical net- 
works that are intrinsically imprecise or error-prone. To this end there is a 
need to disseminate the principles of stability and chaos outside mathemat- 
ics, so that non-mathematical scientists are better-equipped to understand 
and manage the dynamics of complex natural and anthropogenic systems, 
and channel uncertainty into stable output. 
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How will these problems, fundamental and applied, be tackled? How will 
the science of dynamical systems, stability and chaos advance? We suggest 
that the three main approaches will be used in synergy: qualitative and 
asymptotic analysis, interdisciplinary collaboration, and computation. 

The rapid growth of interest in dynamical systems and chaos over the 
past 30 years is, in a sense, quite different from the way that areas of 
mathematics and physics developed in earlier times. It is not driven by 
industrialization, as for example was thermodynamics in the 19th century 
and classical control in the early 20th century, or by defence and cold war 
imperatives, as was nuclear physics from the 1940s to the 1960s. What 
we are seeing now is the reverse: theory and mathematics of dynamical 
systems and chaos together with faster computers are actually driving de- 
velopments in a wide range of very diverse fields, from medical imaging to 
art restoration, traffic control to ecosystems, neuroscience to climatology. 
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Glossary 

The terms highlighted in bold-faced type in their first appearance in 
the text are defined or described in this glossary. More comprehen- 
sive glossaries of dynamical systems terminology may be found eas- 
ily on the web; for example, mrb.niddk.nih.gov/glossary/glossary.html, 
www.dynamicalsystems.org/gl/gl/. 

Asymptotic solutions: Solutions which asymptotically approach an un- 
stable periodic solution. 

Homoclinic points or doubly asymptotic solutions: Points at which 
stable and unstable manifolds intersect transversally. In a Hamilto- 
nian flow the stable and unstable manifolds must intersect transver- 
sally infinitely often (or coincide, as in the harmonic oscillator, 
Equation [TTj) because otherwise one of them would shrink and vol- 
ume conservation would be violated. This remains true for dissipa- 
tive systems^! 

Homoclinic chaos or homoclinic tangle or sensitive dependence 
on initial conditions: A region densely packed with homoclinic 
points, where the dynamics is equivalent to and described by the 
Smale horseshoe map. Arbitrarily close initial conditions must ac- 
tually belong to totally different parts of the homoclinic tangle, 
therefore they evolve quite differently in time. 

Poincare map and cross section: A sort of stroboscopic map; an ex- 
tremely useful way of representing the dynamics of a two de- 
gree of freedom system on a plane. Consider the set of trajecto- 
ries of a two degree of freedom Hamiltonian system that satisfy 
H(pi,P2iQi,Q2) = C, where C is a constant and pi,qi and P2,Q2 
are canonical action-angle variables. Each energy level H = C is 
therefore three-dimensional. To construct a Poincare map we take a 
two-dimensional transverse surface or cross section E such as that 
defined by q2—0- Then, for given C the value of P2 can be com- 
puted by solving the implicit equation H(pi,p 2 , qi,Q) = C, so that 
we may locally describe E by the two variables (qi,pi). Successive 
punctures of the surface E in one direction by each trajectory form 
a stroboscopic map of the time evolution of the trajectory in phase 
space. 

Recurrence theorem: A volume-preserving system has an infinite num- 
ber of solutions which return infinitely often to their initial posi- 
tions, or an infinite number of Poisson stable solutions. 
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Hopf bifurcation: The real parts of a pair of conjugate eigenvalues be- 
come positive and a family of periodic orbits bifurcates from a 
"spiral" fixed point (a focus). 

Neimark-Sacker bifurcation or secondary Hopf bifurcation: Consider a 
periodic orbit with period T = 2ir/ui and suppose that a pair of 
Floquct multipliers crosses the unit circle at ±e lLJ2 at an isolated 
bifurcation point. An invariant torus is born. Solutions on the torus 
are quasi-periodic, and if qu>i = pu>2 for integers p and q the motion 
is said to be phase-locked. The Floquet multipliers are related to 
the eigenvalues of the Poincare map linearised at the fixed point 
corresponding to the original T-periodic orbit. 



